Redundant Information Neural Estimation
نویسندگان
چکیده
We introduce the Redundant Information Neural Estimator (RINE), a method that allows efficient estimation for component of information about target variable is common to set sources, known as “redundant information”. show existing definitions redundant can be recast in terms an optimization over family functions. In contrast previous decompositions, which only evaluated discrete variables small alphabets, we optimizing functions enables approximation high-dimensional and continuous predictors. demonstrate this on image classification motor-neuroscience tasks.
منابع مشابه
Learning efficiency of redundant neural networks in Bayesian estimation
This paper proves that the Bayesian stochastic complexity of a layered neural network is asymptotically smaller than that of a regular statistical model if it contains the true distribution. We consider a case when a three-layer perceptron with M input units, H hidden units and N output units is trained to estimate the true distribution represented by the model with H(0) hidden units and prove ...
متن کاملGeneric Estimation Procedures for Orientation with Minimum and Redundant Information
1 Motivation Orientation of cameras with minimum and redundant information is the rst step in 3D-scene analysis. Compared to image interpretation it looks simple, it seems to be solved in photogrammetry and is expected to be implemented within a few weeks. All experience shows that camera calibration and orientation needs much eeort and the solutions provided in photogrammetric textbooks cannot...
متن کاملMine: Mutual Information Neural Estimation
We argue that the estimation of the mutual information between high dimensional continuous random variables is achievable by gradient descent over neural networks. This paper presents a Mutual Information Neural Estimator (MINE) that is linearly scalable in dimensionality as well as in sample size. MINE is backpropable and we prove that it is strongly consistent. We illustrate a handful of appl...
متن کاملHammerstein-Wiener Model: A New Approach to the Estimation of Formal Neural Information
A new approach is introduced to estimate the formal information of neurons. Formal Information, mainly discusses about the aspects of the response that is related to the stimulus. Estimation is based on introducing a mathematical nonlinear model with Hammerstein-Wiener system estimator. This method of system identification consists of three blocks to completely describe the nonlinearity of inp...
متن کاملProcessing Redundant Information
When stimuli differed on two dimensions (size and brightness), either of which could furnish sufficient information for a correct response, reaction times were faster than when stimuli differed on only one dimension. This result holds true even when individual differences in dimension preferences are taken into account. A model of parallel processing of the different dimensions is proposed and ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2021
ISSN: ['1099-4300']
DOI: https://doi.org/10.3390/e23070922